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® Target recognition using quantization indexes. 



@ An apparatus lor detecting the presence of a 
target in an n-dimensional array of digital data sam- 
ples comprisos* 1) a reading module, which reads 
the samples from the data array in overlapping 
groups; 2) a quantizing module, coupled to the read- 
ing module, which quantizes each of the overlapping 
groups of data samples and which generates an 
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index that identifies the quantized group; and 3) a 
comparing module, coupled to the quantizing mod- 
ule, which compares indexes from the quantizing 
module to multiple reference indexes, each of which 
represents a quantized group of data samples that 
identify a distinctive feature of the target. 
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BACKGROUND OF THE INVENTION 

This invention relates to methods and appara- 
tus for detecting the presence of a target in a 
scene that is described by an n-dimensional array 
of digital data samples. 

Such an array can have X and Y dimensions 
which are perpendicular to each other, and the data 
sample at each X,Y location can give the intensity 
of light at that location. As another example, the 
array can have three dimensions X. Y, and 2 which 
are perpendicular to each other; and the data sam- 
ple at each X,Y.2 location can give the intensity of 
an x-ray at that location. As still another example, 
the array can have just a single dimension X; and 
each data sample along that dimension can give 
the magnitude of a voltage signal which comes 
from a microphone and represents speech or other 
sounds. 

In each of the above arrays, a target that is to 
be recognized can be of any type. For example, in 
the above two-dimensional case, the target can be 
an airplane or a car; in the above three-dimensional 
case, the target can be a fracture in a bone; in the 
above one-dimensional case, the target can be 
certain words. 

In the prior art. target recognition has been 
performed by comparing a data sample template of 
the target to all possible areas in the sampled data 
scene in which that template could occur. However, 
a major drawback of such a method is that it 
requires an extremely large number of compari- 
sons to be performed; and that, in turn, limits the 
speed at which the targets can be recognized. 

For example, consider the case of a two-di- 
mensional scene which is described by a sampled 
data array that is 512x512 samples in size. Such a 
data array would make up a single frame of a 
television picture. Further assume that the target 
which is to be recognized fits into an area that is 
20x20 data samples in size. To compare a 20x20 
template of the target with just a single 20x20 
portion of the sampled data scene would require a 
total of 400 comparisons. But in the entire 512x512 
sampled data scene, the total number of 20x20 
scene portions that exist is [512-20 + 1][512-20 + 1] 
or 243,049; and. each such scene portion needs to 
be compared on the target template. Thus, the total 
number of comparisons that need to be performed 
is (400)(243.049) or 97.219,600. 

In addition, even after all of the above compari- 
sons are made, a determination still cannot be 
made as to whether or not the target occurs in the 
scene. This is because, in any practical case, each 
target has a large number of variations. For exam- 
ple, the light intensity on parts of the target relative 
to the background can be increased or decreased. 
Also, the angular orientation of the target relative to 



the background can be rotated anywhere within 
360*. To account for all of these variations, many 
templates would have to be provided for each 
target; and, the above 97,219,600 comparisons 

s would have to be performed using each template. 

Accordingly, a primary object of the invention 
is to provide an improved method of recognizing 
targets which can be performed substantially faster 
than the above-described prior art method. 

10 Another object of the invention is to provide an 

apparatus for carrying out the steps of the im- 
proved target recognition process. 

BRIEF SUMMARY OF THE INVENTION 

75 

Disclosed is an apparatus for detecting the 
presence of a target in an n-dimensional array of 
digital data samples where n is any positive in- 
teger. Each data sample contains a certain number 

20 of data bits, such as eight bits. Also, in accordance 
with the invention, the disclosed target recognition 
apparatus comprises: 1) a reading module, which 
reads the samples from the data array in overlap- 
ping groups; 2) a quantizing module, coupled to 

25 the reading module, which quantizes each of the 
overlapping groups of data samples and which 
generates an index that identifies the quantized 
group; and 3) a comparing module, coupled to the 
quantizing module, which compares indexes from 

30 the quantizing module to multiple reference in- 
dexes, each of which represents a quantized group 
of data samples that identify a distinctive feature of 
the target. 

In one embodiment, the comparing module 

35 compares indexes of quantized groups of data 
samples in a predetermined order until a match to 
one of the reference indexes occurs; and there- 
after, the comparing module compares indexes of 
quantized groups of data samples within a window 

40 around the index which caused the match. This 
embodiment further includes a. metric module 
which evaluates a metric based on any indexes 
within the window that match the reference in- 
dexes. If the evaluated metric meets a threshold 

45 criteria, the metric module signals that a target has 
been detected. 

In another embodiment, the comparing module 
again compares indexes of quantized groups of 
data samples in a predetermined order until a 

50 match to one of the reference indexes occurs. 
Then, in response to that match, a correlation mod- 
ule aligns a data sample template to the data array 
based on the target feature which caused the 
match. Data samples are then read from the data 

55 array in the template area and spatially correlated 
to the template. If the correlation meets a threshold 
criteria, the correlation module signals that a target 
has been detected. 
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With both of the above embodiments, the 
speed at which targets are recognized, in compari- 
son to the prior art. is substantially increased. One 
reason for this is that each reference index repre- 
sents an entire group of data samples which in turn 
identify a complete distinctive feature of the target. 
Further, since the data samples from the data array 
are quantized, and since the reference indexes also 
represent quantized data samples, variations of in- 
tensity in the raw data samples of a scene or target 
are accounted for. Also, due to the quantizing, 
angular orientations of a target feature over 360" 
are covered by rotating that feature in increments 
of 45* and having just eight reference indexes 
respectively represent the quantized groups of data 
samples that occur at each of those angles. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Various embodiments of the invention, as well 
as their features and advantages, are described 
herein in conjunction with the accompanying draw- 
ings wherein: 

FIG, 1 illustrates a scene which contains several 
objects, some of which are to be detected as 
targets; 

FiG. 2 illustrates how the scene of FIG. 1 is 
represented by an n-dimensional array of digital 
data samples: 

FIG. 3A shows a distinctive feature of a target in 
the scene of FIG, 1 whereas FIG. 3B shows how 
the feature of FIG. 3A is represented by a group 
of digital data samples; 

FIG. 4 shows four groups of digital data sam- 
ples, each of which represents a minor variation 
of the FIG. 3A target feature; 
FIG. 5 shows a quantized group of data samples 
which represent the FIG. 3A target feature and 
all or substantially all of its variations; 
FIG. 6A illustrates the target feature of FIG. 3A 
in a rotated position, whereas FIG. 66 shows a 
group of data samples which represent that 
rotated target feature; 

FIG. 7 shows a group of quantized data samples 
which represent the FIG. 6A target feature and 
all or substantially all of its variations; 
FIG. 8 shows another distinctive feature of the 
target in FIG. 1; 

FIG. 9 illustrates some initial steps of the target 
recognition process during which overlapping 
groups of data samples in the n-dimensional 
data array are quantized and stored in an index 
array: 

FIG. 10 illustrates further steps of the target 
recognition process during which windows within 
the index array are opened and searched for 
reference indexes; 

FIG. 11 illustrates final steps of the target rec- 
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ognition process during which a metric is evalu- 
ated to determine if a target occurs within the 
window; 

FIG. 12 illustrates an apparatus which performs 
5 all of the target recognition steps of FIGs. 9, 10. 
and 1 1 ; and 

FIGs. 13A-13E are flow charts of respective pro- 
grams which are stored in and direct the opera- 
tion of the FIG. 12 apparatus. 

TO 

DETAILED DESCRIPTION OF THE INVENTION 

Referring now to FIG. 1, it shows a picture of 
an airport that will be used herein to explain the 

IS manner in which the present invention operates. In 
FIG. 1. reference numeral 10 indicates a hangar; 
reference numerals 11a and lib indicate respec- 
tive airplanes; reference numerals 12a, 12b and 
12c indicate respective cars; reference numeral 13 

20 indicates a portion of a runway; reference numeral 
1 4 indicates a portion of a driveway; and reference 
numeral 15 indicates some background. Through 
the use of a digital optical scanner, all of the 
objects 10 thru 15 can be represented by a two- 

25 dimensional array of sampled data signals. And, by 
means of the present invention, various targets 
such as the airplanes 11a and 11b can be detected 
in the sampled data array. 

Figure 2 shows how a portion of the FIG. 1 

30 scene is represented by the data sample array. In 
FIG. 2, reference numerals R1, R2. R3. ... indicate 
respective rows of data samples while reference 
numerals CI. C2. C3, ... indicate respective col- 
umns of data samples. At the intersection of each 

35 row-column pair lies a data sample which conven- 
tionally is called a pixel. Each data sample has a 
certain magnitude which is proportional to the light 
Intensity in the scene at the location of the sample. 
Suitably, each data sample is eight binary data 

40 bits; and the light intensity ranges from a value of 
zero (for the darkest intensity) to a value of two 
hundred fifty-five (for the brightest intensity). In 
FIG. 2, the data sample at row R8 column Cl has a 
value 0; the data sample at row R8 column C3 has 

45 a value 255; and the data sample at row R8 column 
C2 has a value of about 125. 

Now in accordance with an initial aspect of the 
invention, a group of adjacent data samples is 
selected which identifies a distinctive feature of the 

50 target. For example, as FIG. 3a shows, the distinc- 
tive feature can be a wing tip 20; and the group of 
data samples which identify that distinctive feature 
is three rows high by three columns wide. Inspec- 
tion of FIG. 3A shows that the light intensity on the 

55 wing tip 20 is much brighter than the light intensity 
of the background around the wing tip. These dif- 
ferent light intensities are indicated by the data 
sample values of FIG. 38. 

3 
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However, the group of data sample values 
which are given In FIG. 3B are not the only data 
sannple values that can represent the wing tip 20. 
Those FIG. 3B data sample values can be de- 
creased by simply adding more shading to the 
wing tip 20 and/or the background 21; and vice 
versa. Also, the data sample values of FIG. 3B can 
be modified by shifting or rotating the position of 
the wing tip 20 slightly. Four examples of such 
shading and/or reorienting differences are indicated 
by the groups of data sample values in FIG. 4. 

Thus, in order to capture all or a substantial 
portion of all of tne above wing tip variations, an 
allowable range oi values is specified for each data 
sample in the group One such range is shown in 
FIG. 5. ThofC. the wing tip 20 is represented by 
four data sample? 20'. each of which has a value 
that ranges from 255 to 150; and five background 
data samples 2V, each of which have a value that 
ranges from 0 to 1 00. This FIG. 5 group of data 
samples is then identifioc by a single reference 
index X, which, for example, is a single 8-bit num- 
ber. 

Next in accordance with the Invention, the se- 
lected target feature of FIG. 3A is rotated in incre- 
ments through 360* ; and. at each incremental po- 
sition, a group of data sample values and cor- 
responding index is selected to represent the target 
feature. This is illustrated in FIGs. 6A, 6B, and 7. In 
FIG. 6A. reference numeral 20r indicates the wing 
tip 20 after tt has been rotated 45° in a clockwise 
direction, arxl reference numeral 21 r indicates the 
background arourxJ the wing tip after it has been 
rotated in the same fashion. 

Inspection of the relative amount of light in 
each row-column location in the FIG. 6 A array 
shows that the light intensity at each such location 
can be represented by the group of data samples 
that is given in FIG. 6B. Then, to accommodate 
shading variations and minor position changes of 
the wing tip 20r and the background 21 r, each of 
the FIG. 6B data samples is assigned a certain 
range of values. One such range is shown in FIG. 
7. There, four of the data samples 20r* which fall 
primarily on the v/ing lip 20r range in value from 
255 to 150; whereas the remaining data samples 
which fall primarily on the background range from 
0 to 100. This FIG. 7 group of data samples is then 
identified by another reference index X+1. 

In like fashion, reference indexes are obtained 
for other angular orientations of the FIG. 3A wing 
tip In increments of 45*. Indexes for each such 
orientation are obtained by repeating the process 
of FIGs. 6A, 68, and 7. Alternatively the range of 
values for the group of data samples that represent 
the rotated wing tip feature can be obtained by 
simply shifting all of the data sample values of FIG. 
5. except the center sample, in a clockwise direc- 



tion. For example, the FIG. 7 data sample values 
around the perimeter of that group are the same as 
the FIG. 5 data sample values shifted clockwise by 
one position. A total of seven such clockwise shifts 
5 can be made, and the groups of data samples that 
result from such shifts are identified by respective 
indexes X+1, X + 2, ... X + 7. 

If the target that is to be recognized has mul- 
tiple distinctive features, then all of the steps that 
70 have been explained above in conjunction with 
RGs. 3A thru 7 are repeated for each of those 
features. For example, another distinctive feature of 
the airplanes 11a and lib occurs where a portion 
of the plane's wing joins a portion of the plane's 
75 body. This is illustrated in RG. 8 wherein reference 
numeral 31 indicates the wing portion of the plane; 
reference numeral 32 indicates the body portion of 
the plane; and reference numeral 33 indicates 
background. All of the items 31 . 32, and 33 can be 
20 represented by a group of data samples, each of 
which has a certain range of values; and that group 
of data samples can in tum be identified by a 
single reference index Y, Likewise, rotations of the 
FIG. 8 feature in increments of 45' can be repre- 
ss sented by respective reference indexes Y + 1 , Y + 2, 
... Y + 7. 

After the above steps are carried out, the data 
samples which make up the entire scene that is to 
be searched for targets is processed as illustrated 

30 in FIG. 9. In that figure, reference numeral 40 
indicates a portion of the data samples in the 
scene that is to be searched; and reference nu- 
meral 41 indicates an index array which is formed 
by processing the samples in array 40. Rows in 

35 both of the arrays 40 and 41 are indicated by 
reference numerals R1, R2, ...; and columns are 
indicated by reference numerals 01, 02, .... 

To generate an entry in the index array 41, a 
group of data samples in the data array 40 are 

40 quantized; and an index which represents that 
quantized group of data samples is placed in the 
index array. For example, the group of data sam- 
ples "A" in the data array 40 are quantized and 
represented by the index Ai in the index array 41 . 

45 This quantizing step is performed on all overlap- 
ping groups of data samples in the array 40 which 
differ from one another by one row or one column. 
For example, the group of data samples "B" in 
array 40 is quantized, and those quantized samples 

50 are represented by an index Bi in the array 41 . 

Next in accordance with the invention, the in- 
dexes in the array 41 are read in a predetermined 
order and compared to all of the reference indexes. 
For example, the indexes in row R1 of the array 41 

55 can be read and compared one at a time from left 
to right; then the indexes in row 2 can be read and 
compared one at a time from left to right; etc. This 
reading and comparing continues until a match to 
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one of the reference indexes occurs. 

Such a nnatch indicates the possible detection 
of a target. However, a single match does not 
guarantee that a target is present since the scene 
that is being scanned contains many other objects 
- some of which nnay also cause the match. To 
avoid this problem in accordance with the inven- 
tion, a window W1 is opened in the index an-ay 41 
when a match occurs as is shown in FIG. 10. This 
window is made large enough to encompass the 
index which caused the match pius ail of the in- 
dexes from a complete target. Indexes within the 
window are compared to the reference indexes; 
and those indexes which match the reference in- 
dexes are applied to a metric. If the evaluated 
metric meets a certain threshold criteria, a signal is 
generated which indicates that a target has been 
found. 

For example, within the window W1 of FIG. 10. 
the quantized group of data samples that are iden- 
tified by reference index X occurs two times, and 
five rotations of those data samples as identified by 
indexes Xr also occur. This is stated by equation 1 
in FIG. 11. However, a metric which requires two 
occurrences of the reference index x and five oc- 
currences of the indexes Xr would be too restric- 
tive since it would not detect a target in all of its 
various possible orientations. This is evident from 
inspection of plane #2 in window W2 of FIG. 10. 

In window W2, the quantized data samples that 
are identified by reference index X occur just one 
time, and the rotated data samples as identified by 
indexes Xr occur six times. This is stated in FIG. 
1 1 by equation 2. Thus, by deduction, one suitable 
metric for the detection of a plane having any 
orientation is the occurrence of any five class X 
indexes within a window of the index anray 41. 
where a class X index is defined to be the indexes 
X and Xr. 

Equation 3 could also be modified to require 
fewer or more occurrences of the class X indexes. 
Requiring fewer indexes lowers the threshold cri- 
teria of the metric, where requiring more indexes 
raises the threshold criteria- Having a low threshold 
allows for potential mismatches with the reference 
indexes; however, a threshold which is too low will 
allow a non-target object to be falsely identified as 
a target. 

In like fashion, the reference index Y and its 
rotations can be used with a metric to detect the 
presence of a target within a window. For example, 
in window W1 , reference index Y occurs two times 
and its rotations occur six times. This is stated by 
equation 4. In window W2, reference index Y oc- 
curs one time and its rotations occur seven times. 
This is stated by equation 5. Thus, another suitable 
metric for the detection of a target is the occur- 
rence of any six class Y indexes within a window. 
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This is stated by equation 6. 

Various combinations of the reference indexes 
X and Y and their rotations can also be used as a 
metric. For example, as equation 7 states, the 

5 detection of a plane can be signaled by the occur- 
rence within a window of any four class X indexes 
plus the occurrence of any four class Y indexes. 

Turning now to FIG. 12. it shows an apparatus 
which carries out all of the above-described target 

10 detection steps. This apparatus includes several 
modules that are identified by reference numerals 
50 thru 61 . Each of these modules and their inter- 
connections are as follows. 

Module 50 is a sensor or transducer. It senses 

16 signals of any desired type from a scene that is to 
be searched on an input 50a, and it converts those 
signals to output voltages on a lead 50b. For exam- 
ple, sensor 50 can be of a type which senses 
optical signals, infrared signals, radar signals, x-ray 

20 signals, or sound signals on its input 50a and which 
converts them to the voltages on lead 50b. 

Module 51 samples and digitizes tiie voltages 
on the leads 50b, Each such digital sample is in 
the form of a binary number that is generated on 

25 output leads 51a. Also, to indicate when a digital 
sample is present, module 51 generates a control 
signal on an output lead 51b. 

Module 52 is a digital memory. It has data 
inputs Dl which receive the digital data samples on 

30 the leads 51a. and it stores these samples in 
response to address signals and write control sig- 
nals on its control terminals C. Those stored data 
samples are subsequently read from the memory's 
data output terminals DO in response to other ad- 

35 dress signals and read control signals on the con- 
trol terminals C, 

Module 53 Is a register. It receives and accu- 
mulates respective groups of data samples from 
the data array 52 via input terminals 53a. Each 

40 group of data samples is then sent from the regis- 
ter's output terminals 53b to module 54 which is a 
quantizer. Output signals from the quantizer 54 
occur on output lines 54as and they are in the form 
of an index which identifies a quantized group of 

45 data samples to which the sample group in register 
53 belongs. 

Module 55 is a digital memory. It has data 
inputs Dl which receive the quantization indexes on 
the leads 54a, and it stores the indexes in re- 

50 sponse to address signals and control signals on 
control terminals C. Stored indexes are subse- 
quently read from the memory's data output termi- 
nals DO in response to other address signals and 
control signals on the control terminals C. 

S5 Module 56 is a comparator. It has input termi- 

nals 56a which receive indexes from the index 
array 55; and. it compares the received index to all 
of the reference indexes. When a match occurs, 

5 
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module 56 generates a signal on an output lead 
56b which indicates that occurrence. 

Module 57 is a microprocessor. It is coupled 
via an input/output bus 58 to several of the other 
modules, and thus the nnicroprocessor is able to 
transmit and/or receive data and control signals 
to/from those modules. For example, microproces- 
sor 57 is coupled to module 51 which enables the 
microprocessor to test for the presence of a sam- 
ple. Also, microprocessor 57 is coupled to the 
control terminals C of memory 52 which enables 
the microprocessor to direct that memory to write 
and read the data samples. 

Module 59 is a memory which holds several 
programs that the microprocessor 57 executes. 
Ttiese programs are indicated in FIG. 12 by refer- 
ence numerals P1 , P2, P3. P4. and P5. Flow charts 
of those programs are shown in FIGs. 13A thru 
13F. 

Module 60 is a second microprocessor which 
is coupled to the bus 58. In operation, micropro- 
cessor 60 receives selected indexes from the index 
array 55 under the direction of commands from the 
microprocessor 57; and. microprocessor 60 uses 
the indexes which it receives to evaluate a metric. 
If that metric meets a certain threshold criteria, 
then microprocessor 60 signals microprocessor 57 
via the bus 58. 

Module 61 is a third microprocessor which is 
coupled to the bus 58. In operation, microprocessor 
61 receives selected data samples from the array 
52 under the direction of commands from the 
microprocessor 57; and. microprocessor 61 per- 
forms spatial correlations on those data samples, if 
the correlations meet a certain threshold criteria, 
microprocessor 61 signals microprocessor 57 via 
the bus 58. 

Turning now to FIGs. 13A thru 13E. each of the 
programs P1-P5 which microprocessor 57 executes 
will be described. Beginning first with FIG. 13A, it 
shows a flow chart for program PI which loads 
data array 52 with data samples from the sensor 
50. This task is performed by steps 70a-70e. Ini- 
tially, microprocessor 57 forms an address at which 
the first data sample is to be stored. Thereafter, the 
microprocessor stores each sample as they are 
generated at respective locations in the data array 
until a complete scene of samples is stored. By a 
scene is herein meant all of the data samples that 
are to be searched for a target. For example, in the 
case of a two-dimensional array in which data 
samples form a visual image, a scene may be 
512x512 samples. 

Subsequently, program P2 is performed. This 
program reads data samples from array 52 in over- 
lapping groups; those groups are quantized; and 
indexes which identify each group are stored in the 
index array 55. This is performed by steps 71a- 
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71 e. Step 71a addresses the initial group of data 
samples in array 52. Addressed data sample 
groups are read and quantized by steps 71b and 
71c. Step 71 d stores an index which represents a 
6 quantized group of samples in the index array 55. 
Step 71 e determines if all of the data sample 
groups have been quantized, and step 71 f ad- 
dresses the next overlapping group of data sam- 
ples. 

70 Thereafter, program P3 of FIG. 13C is ex- 

ecuted. It performs steps 72a-72e by which in- 
dexes are read in a predetermined order from the 
index array 55 and compared to the reference 
indexes. If a match occurs, then a branch is taken 
75 to either a metric evaluation program P4 or a 
spatial correlation program P5. If the index that is 
being compared is the last index in array 55 and it 
does not match any reference index, then a deter- 
mination is made that no targets are present in the 
20 scene. 

In program P4 of FIG. 13D. a window is 
opened in index anray 55 around the index of step 
72c which caused the match. This window is made 
large enough to include all of the indexes from a 
25 complete target. Indexes are read from that window 
and compared to the reference indexes. If a match 
occurs, then the index which caused the match is 
sent to the metric micnDprocessor 62 which up- 
dates a target recognition metric. If the updated 
30 metric meets a certain threshold criteria, the metric 
microprocessor generates a signal on the bus 58 
indicating that a target is present within the win- 
dow. If. however, the threshold criteria is not satis- 
fied after all of the indexes within the window have 
35 been examined, then program P3 is reentered and 
continued, beginning at step 72d. All of this is 
indicated by reference numerals 73a-73f. 

In program P5. a window is opened in the data 
array 52 around the group of data samples whose 
40 quantization index caused a match in step 72c. 
This window is made large enough to include all of 
the data samples from a complete target. Data 
samples within that window are read by the correla- 
tion microprocessor 61 and spatially correlated to a 
45 template of the target. In performing this correla- 
tion, the template is first aligned to the window 
based on the quantization index which caused the 
match. For example, if index X of FIG. 10 caused 
the match, then three alignments are made. If any 
50 such spatial correlation meets a certain threshold 
criteria, then the correlation microprocessor gen- 
erates a signal on the bus 58 indicating that the 
target is found. If the threshold criteria is not met, 
then program P3 is reentered and continued at 
55 step 72d. 

A preferred process and apparatus for detect- 
ing targets in accordance with the invention have 
now been described in detail. In addition, however, 

6 
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many changes and modifications can be made to 
those details without departing from the nature and 
spirit of the invention. 

For example, the components which are used 
to implement the various modules 50-61 of FIG. 12 
are not limited to any particular type. Microproces- 
sors 57. 60 and 61 suitably are a Motorola 68020 
or an Intel 80386. Data array 52 and index array 55 
can be constructed from any static RAM chips or 
dynamic RAM chips. Comparator 55 can be a 
ROM chip which is addressed by the indexes from 
the array 55 and which at each addressed location 
stores either a one or a zero to respisctively in- 
dicate whether the addressed index matches or 
does not match any reference index. Quantizer 54 
can be any logic circuit which performs the func- 
tion of generating an index on its output terminals 
54a that identifies a quantized group of data sam- 
ples which encompass the particular group of data 
samples that are in register 53. Additional back- 
ground on various quantizers is given in a paper by 
Robert M. Gray entitled "Vector Quantization", 
published in IEEE ASSP Magazine. April. 1984. 

Further, the quantizer 54 need not generate all 
of the indexes that are needed to reconstruct the 
scene that is in the data array 52. All that is 
necessary is for the quantizer to generate the refer- 
ence indexes and one other index which indicates 
that the corresponding group of data samples is 
not a distinctive feature of the target. This can 
significantly reduce the total number of indexes 
which the quantizer generates and thus reduce the 
number of bits per index in the index array. For 
example, suppose that a two-dimensional visual 
scene is stored in the data array 52. To quantize 
groups of data samples from that scene such that 
the scene can be reproduced from the quantization 
indexes typically requires a total of about 256 dif- 
ferent indexes, or eight bits per index. By compari- 
son, to simply identify distinctive target features 
typically requires a total of less than 32 different 
indexes, or five bits per Index. 

Also, the sampled data scene which the 
present invention examines for targets is not limit- 
ed to a two-dimensional visual scene. For example, 
the scene that is examined can have three dimen- 
sions X. Y. and Z which are perpendicular to each 
other with the data sample at each X,Y.Z location 
giving the intensity of an x-ray at that location. As 
another example, the scene that is examined can 
have five dimensions - two of which are X and Y 
locations, and the remaining three of which give 
respective intensities of the colors red. blue, and 
green at the X.Y location. As another example, the 
scene that is examined can have just one dimen- 
sion wherein data samples are stored consecutively 
as they occur in time. Such data samples can. for 
example, be samples of a voltage waveform that 



represents speech from an ordinary microphone. 

Further, the targets which the present invention 
detects are not limited to airplanes. These targets 
can be anything which has a distinctive feature with 

5 respect to the scene in which it lies. For example, 
in the case of a one-dimensional array of speech 
samples, the target can be a set of spoken words 
and the reference indexes can identify quantized 
groups of data samples from distinctive sounds in 

70 the words. In the case of a two-dimensional array 
of data samples of a page of text, the target can be 
a set of written words, and the reference indexes 
can identify quantized groups of data samples from 
the letters in the words. 

75 Also, the groups of samples that are read from 

the data array and quantized are not limited to 
being 3x3 in size. Those data sample groups can 
be any size which is large enough to just barely 
include a distinctive feature of the target This 

20 constraint reduces the amount of circuitry that is 
required to implement the quantizer 54. For most 
optical targets, a practical range for the size of 
each data sample group is from two to twenty 
samples in each direction of the n-dimensional 

25 array 52; whereas for audio targets, a practical 
range for each data sample group is from tifty to 
five thousand samples in the one-dimensional ar- 
ray. 

Further, the quantized groups of data samples. 

30 and their corresponding Indexes, which Identify dis- 
tinctive features of the target, can vary witiri time. 
For example, a target which is to be detected can 
have one set of reference indexes when a daytime 
scene is being searched and a different set of 

35 reference indexes when a nighttime scene is being 
searched. 

In addition, the FIG. 12 embodiment can be 
modified by deleting the index array 55. and cou- 
pling the index output terminals of the quantizer 54 

40 directly to comparator 56 and the I/O bus 58. With 
this modification, the index of a quantized data 
sample group is generated each time it is needed. 
Thus, whenever microprocessor 57 or 60 needs to 
operate on a particular index, the microprocessor 

45 must first address the data array 52 and read from 
it the group of data samples whose quantization 
index is sought. After reading that group of data 
samples, the quantization index, and the result of 
its comparison to the reference indexes, are ob- 

50 tained via the bus 58 from the quantizer 54 and 
comparator 56. 

Also, a wide variety of metrics can be used to 
determine whether the indexes that are found with- 
in an index array window constitute a target For 

55 example, an Euclidean metric, as given below, can 
be used. 

(xrxa)^ + (yt-ya)^ + ...> threshold 



7 

NISDOCID: <EP_0448956A2_I_> 



13 



EP 0 448 956 A2 



14 



In this metric, xj is the number of times index x 
should ideally occur in a window if a target Is 
present; Xg is the number of times index x actually 
occurs in the window; yi and ya are similarly de- 
fined for the y indexes; etc. 

Likewise, various spatial correlations can be 
used, after an index match occurs, to determine 
whether the data samples that Ire within a data 
array window constitute a target. One suitable spa- 
tial correlation is given below. 

i:(dxy)(txy)-(txyF>threSh0ld 

In this correlation, dxy is the data sample at location 
xy in the data array, and txy is the data sample in 
the target template at location xy. 

As another variation, the data samples in the 
data array window can be Sobei filtered prior to the 
correlation step to enhance any edges within the 
window. In that case, the target template would be 
a Sobel filtered image of the target. 

Accordingly, it is to be understood that the 
invention is not limited to the above-described de- 
tails but is defined by the appended claims. 

Claims 

1. Apparatus for detecting the presence of a tar- 
get in an n-dimensional array of data samples, 
where each data sample has a first set of 
values and n is a positive integer; said appara- 
tus comprising: 

a reading means, for reading said data 
samples from said array in overlapping groups; 

a quantizing means, coupled to said read- 
ing means, for quantizing each of said overlap- 
ping groups of data samples such that all of 
the data samples in any one particular group 
are restricted to a second set of values which 
is smaller than said first set and which are 
represented by an index; and, 

a comparing means, coupled to said quan- 
tizing means, for comparing said indexes from 
said quantizing means to multiple reference 
indexes, each of which represents a quantized 
group of data samples that identify a distinc- 
tive feature of said target. 

2, Apparatus according to claim 1 wherein said 
comparing means compares indexes of quan- 
tized groups of data samples in a predeter- 
mined order until a match to one of said refer- 
ence indexes occurs, and thereafter said com- 
paring means compares indexes of quantized 
group:5 of data samples from a window around 
the index which caused said match. 



3. Apparatus according to claim 2 which further 
includes a metric means for evaluating a met- 
ric based on any indexes within said window 
which match said reference indexes and for 

5 signaling the detection of said target if said 

evaluated metric meets a threshold criteria. 

4. Apparatus according to claim 3 which further 
includes an index storage means, coupled be- 

10 tween said quantizing means and said compar- 

ing means, for receiving and storing a plurality 
of indexes from said quantizing means; and an 
index retrieving means for reading indexes 
from said index storage means and sending 

15 them to said comparing means. 

5. Apparatus according to claim 3 wherein said 
reading means, quantizing means, and com- 
paring means are serially intercoupled and op- 

20 erate sequentially one after the other for each 

group of data samples that is read from said 
array. 

6. Apparatus according to claim 1 wherein said 
25 comparing means compares indexes of quan- 
tized groups of data samples in a predeter- 
mined order until a match to one of said refer- 
ence indexes occurs; and thereafter said read- 
ing means reads data samples from a window 

30 around the data sample group whose index 

caused said match. 

7. Apparatus according to claim 6 which further 
includes a correlation means for spatially cor- 

25 relating data samples within said window to 

templates of said target and for signaling the 
detection of said target If said correlation 
meets a threshold criteria. 

40 8. Apparatus according to claim 7 which further 
includes an index storage means, coupled be- 
tween said quantizing means and said compar- 
ing means, for receiving and storing a plurality 
of indexes from said quantizing means; and an 

45 index retrieving means for reading indexes 

from said index storage means and sending 
them to said comparing means. 

9. Apparatus according to claim 7 wherein said 
so reading means, quantizing means, and com- 
paring means are serially intercoupled and op- 
erate sequentially one after the other for each 
group of data samples that is read from said 
array. 

65 

10. Apparatus according to claim 1 wherein a first 
one of said reference indexes represents a 
quantized group of data samples from a cer- 
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tain distinctive feature of said target, and a 
second one of said reference Indexes repre- 
sents a quantized group of data samples from 
a different distinctive feature of said target. 

5 

11. Apparatus according to claim 1 wherein a first 
one of said reference indexes represents a 
quantized group of data samples from a cer- 
tain distinctive feature of said target, and a 
second one of said reference indexes repre- io 
sents a quantized group of data samples from 

the same feature with a different orientation. 

12. Apparatus according to claim 1 wherein each 
overlapping group of data samples is from two 75 
to twenty samples in all of said n-dimensions. 

13. Apparatus according to claim 1 wherein said 
data samples in said array are selected from 

the group consisting of optical samples, in- 20 
frared samples, radar samples, x-ray samples, 
and sound samples. 

14. Apparatus for detecting the presence of a tar- 
get in an array of data samples; said apparatus 25 
comprising: 

a memory means having stored therein a 
plurality of indexes, each of which represents a 
quantized group of data samples from said 
array; 30 

an index retrieving means, coupled to said 
memory means, for reading said indexes in a 
predetermined order; and, 

a comparing means, coupled to said mem- 
ory means, for signaling whether or not said 35 
indexes from memory means match a refer- 
ence index which represents a quantized 
group of data samples that identify a distinc- 
tive feature of said target. 

40 

15. Apparatus according to claim 14 wherein said 
data samples in said array are selected from 
the group consisting of optical samples, in- 
frared samples, radar samples, x-ray samples, 

and sound samples. 45 

16. A method of detecting the presence of a target 
in an n-dimensional array of data samples 
where n is a positive integer; said method 
including the steps of: 50 

reading said data samples from said array 
In groups; 

quantizing each group of data samples 
that is read and identifying each quantized 
group with an index; and, 55 

comparing said indexes that are obtained 
by said quantizing step to a reference index 
which represents a quantized group of data 



samples that identify a distinctive feature of 
said target. 

17. A method according to claim 16 wherein said 
comparing step is performed on multiple refer- 
ence indexes, each of which represents a 
quantized group of data samples for a different 
distinctive feature of said target. 

18. A method according to claim 16 wherein said 
comparing step is performed on a class of 
several reference indexes, with each index of 
said class representing a quantized group of 
data from a single distinctive feature of said 
target but with a different orientation. 
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